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AGENT-BASED WEB SEARCH ENGINE 

FIELD OF THE INVENTION 

The present invention relates generally to the field of information search and 
retrieval, and more particularly, to an agent-based Web search engine that improves 
keyword-based searches by utilizing a user profile to further restrict the search to 
documents of interest to the user. The present invention utilizes a network of 
collaborating agents that track and use information from the browsing behavior of other 
similar users. 

BACKGROUND OF THE INVENTION 

Previous approaches to finding information on the World Wide Web (WWW) 
have included automated searching programs (search engines) such as WAIS or Web 
crawler (M. Koster, World Wide Web Wanderers, Spiders and Robots; http:// 
web.nexorxo.uk/mak/doc/robots/robots.html) to locate web sites and information of 
interest to the user. These automated search engines suffer from the problem of 
returning too many search results, frequently by including documents of marginal or 
low relevance, reducing the usefulness of the search to the user. These typical 
approaches fail to consider any measure of the user interest in conducting the search. 
These prior art approaches use a measure of interest based only on the search keywords 
entered by the user. As a consequence, these search approaches return all documents 
which contain the search terms, including documents which are in subject areas 
unrelated to the user's area of interest. However, frequently background information is 
available which can be applied to the search. These prior art approaches do not use this 
valuable background information to eliminate documents which are not relevant to the 
user. User satisfaction with these prior art search engines is therefore low. 

Lieberman in "Letizia: An Agent that Assists in Web Browsing", International 
Joint Conference on Artificial Intelligence, 1995, describes an approach that uses a 
single agent to assist the user browsing the World Wide Web. In the Lieberman 
approach, the agent tracks user behavior and attempts to anticipate documents of 
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interest by autonomously exploring links from the user's current position. This 
approach infers search goals from the user's browsing behavior and makes unsolicited 
recommendations of "interesting" documents. One of the drawbacks of this prior art 
approach is that it focuses on the behaviour of the individual user without considering 
other information which can be gleaned from community interest in the documents and 
information. 

It is a reasonable assumption that documents and information of interest to one 
person in a community would likely be of interest to another. Valuable information 
obtained from the browsing behaviour of other users can be used to focus the search. 
Therefore, an approach which tracks and uses information from the browsing behavior 
of other users "similar" to the user can be used to facilitate the search process to 
ascertain relevant documents. 

Furthermore, a search mechanism which is augmented by utilizing a network of 
collaborating agents to track browsing behavior and guide searches would improve the 
effectiveness of the search. 

SUMMARY OF THE INVENTION 

According to one aspect of the present invention, there is provided a method for 
searching that uses social filtering between collaborating agents to track user behavior 
and to guide the search for documents and information stored in electronic form. 

The present invention records background information about each user in a user 
profile. User profiles are learned from a training set of pages or by observing user 
behavior. 

The method of the present invention increases the number of search results 
which are likely to be perceived by the user as highly relevant because of a "peer 
effect". The present invention allows the use of best-first search of the Web which 
performs better than the depth-first or breadth-first search used in past approaches. The 
approach according to the present invention is also highly scalable, since each agent 
manages only a small subset of users and documents, as compared to other known 
social filtering approaches (e.g. Maes, P. "Agents that Reduce Work and Information 
Overload", Communications of the ACM, July, 1994). 
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According to another aspect of the present invention, there is provided a method 
for searching and identifying relevant documents from an electronic search comprising 
the steps of: 

(a) attaching a user profile to a user desiring to conduct a search; 

(b) attaching a document profile to each searchable document; 

(c) obtaining search parameters; 

(d) attaching the user profile to the search; 

(e) initiating the search with search parameters; 

(0 searching the searchable documents to identify candidate documents: 

(g) comparing the user profile to the document profile corresponding to the 
candidate document to determine a successful or unsuccessful match; 

(h) returning the candidate document if successful match. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram depicting an overview of a networked system 
implementing the search mechanism of the present invention. 

Figure 2 is a block diagram of a search tree for searching web pages illustrating 
the use of the present invention. 

Figure 3 is a block diagram depicting the present invention implemented in Java. 

Figure 4 is a flowchart diagram illustrating the executing of the search 
commands of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

According to the present invention, there is provided an agent based web search 
engine where agents are used to assist users and communicate information to facilitate 
efficient searches. The data that is communicated among agents pertains to user profiles 
about individual users on the web as well as web page profiles regarding the particulars 
of various web pages. 

The present invention tracks and uses information gathered on the browsing 
behavior of users that are "similar" to the user searching for information, utilizing a 
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process known as social filtering. The concept of social filtering has been described by 
Maes (referred to herein above), and by Lashkari, Y. et al. "Collaborative Interface 
Agents", Conference of the American Association of Artificial Intelligence, 1994. 
Social filtering, in its basic unmodified form r does not base its correlations on the 
5 content of information but rather on correlations solely among the users or viewers of 
such information. Social filtering uses information about a user's social environment as 
a guide to locating relevant documents and information. 

In the implementation of social filtering, information about the interests of 
individual users is gathered. Then, during the search phase information is filtered for 

1 0 relevance by exchanging data about the users who have expressed an interest in the 
information. Social filtering has, for example, been successfully applied to make 
recommendations about music records. 

Turning to Figure 1 , a networked system implementing the present invention is 
shown. Web server 110 is connected to local area network 104. Local area network 

15 104 is in turn connected to the World Wide Web (WWW) 102. Likewise, web server 
1 12 is connected to local area network 106, which is connected to World Wide Web 
102. Web servers 110 and 112 are standard Internet or Intranet computing machines, as 
are well known in the art, that are capable of displaying web pages of hypertext markup 
language (HTML) format. HTML is a well known markup system used to create 

2 0 hypertext documents that are portable from platform to platform. To accomplish the 
communication tasks required of the present invention, web servers 1 10 and 1 12 use 
standard network communication schemes and the Internet Hypertext Transfer Protocol 
(HTTP) which allows the transfer of information from client to server. While the 
invention hereinafter will be described with respect to HTML web pages using HTTP, 

25 it is within the scope of this invention that other document formats and protocols could 
be used. 

HTML web pages are stored in computer memory 1 14 of web server 1 10 and 
are made accessible to local users 118 and 120 as well as remote users 122 and 124 
through the World Wide Web 102. Likewise, other web pages are stored in computer 
30 memory 116 of web server 112 which are available to local users 118 and 120 as well 
as remote users 122 and 124 through World Wide Web 102. Local users 118 and 120 
and remote users 122 and 124 use a standard web browser, such as NetScape" 4 from 
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NetScape Communication Corporation or Microsoft Internet Explorer™ from Microsoft 
Corporation, which can read the HTML coded web pages. Each of users 118, 120, 122 
and 124, as well as each web page in memory 114 and 116 have an accessible address 
or universal resource locator (URL) which can be used by users, agents or other 
network devices for locating and accessing user or web page information. 

In the preferred embodiment, agents are used to perform tasks on the user's 
behalf, train or teach the user, help different users collaborate, and monitor events and 
procedures. In particular, various user and web page profiles are managed by agents. 
In addition, searches are facilitated by the communication and collaboration of agents. 
In the preferred embodiment, agents employ social filtering relying upon correlations 
drawn between different users in identifying relevant documents and information. 

As shown in Figure I , agent 126 manages a portfolio of user profiles for local 
users 118 and 120 on web server 110. Agent 126 also manages a portfolio web page 
profiles for each web page stored in memory 114 of web server 110. Agent 128 
manages a portfolio web page profiles for each web page stored in memory 1 16 of web 
server 112. In addition, agent 130 manages the user profile for user 122, while agent 
132 manages the user profile for user 124. Particulars of the profiles and the 
information managed and communicated by agents 126, 128, 130 and 132 is described 
in further detail below. 

A user profile, such as managed by agent 126, 128, 130 and 132 is a description 
of background information about a particular user. It is created by identifying and 
listing specific features or areas of interest to the user. One method of representing this 
profile is as a vector where each element represents the user's interest in a particular 
feature. Therefore, in the general case, the Boolean feature vector {u |f . . . uj, each 
Boolean value u k indicates whether the particular feature k is of interest to a user. For 
example, features for comparison could be defined as: (a) cars; (b) sports; (c) cooking. 
If a user is interested in cars and sports, but not interested in cooking, their profile 
would be represented as the feature vector {1, 1,0}, where the 1 represents true and 0 
represents false. This profile could then be used to correlate with profiles of user's 
with similar interests. 

A web page profile is merely a list of the profiles of users who have visited that 
web page document. It may be implemented as a list of the actual user profiles, or 
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merely a pointer to the agent managing each user's profile. For example, in one 
embodiment, a web profile can be set up by an agent as a table of {feature, user id, 
interest} tuples. 

An example of such is set out in Table 1 below, such as: 



User id 



Feature 


a, 


a 2 


a 3 


cars 


1 


0 


0 


sports 


1 


1 


1 


cooking 


0 


1 


1 


Java 


0 


0 


0 


Internet 


1 


0 


1 



TABLE 1 



The web page profile is updated as a new user visits that web page, in a similar 
manner to which a web page hit counter is updated. 

Before a search can be conducted, it is necessary to create user profiles. While 
user profiles could be manually generated, the preferred approach is to generate user 
profiles during a learning operation. During the learning operation, users will be 
presented with a set of web pages or questions and asked to indicate their interest by 
responding with either yes or no. Training pages are prepared such that they are 
associated with a set of features that will be included in the user profile. Therefore, 
given the set of positive examples of concepts (or web pages) that the user is interested 
in, and the set of negative examples (or web pages) the user is not interested in, the set 
of features that distinguish pages rated as interesting from those that are not can be 
learned through an information theoretic approach. The use of an information theoretic 
approach has been disclosed by Lang K. "Newsweeder: Learning to filter News." 
Twelfth International Conference on Learning, 1995 and M. Passani et al., "Syskeil & 
Webbert: Identifying Web Sites", AAAI, 97; http:// 

www.ics.uci.edu/"pazzani/RTF/AAAI.html, 1997. Training pages that are highly 
matched with a user's interest may subsequently be suggested to the user as starting 
points for exploration of the web. This provides the additional advantage of directing 
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the user to a web server that supports the agent based web server engine. 

The present invention is better illustrated by way of an example. Turning to 
Figure 2, the search tree depicting the typical search actions of users of Figure 1 is 
shown in greater detail. The search is represented by numerous nodes 202, 204, 206, 
208, 210, 212, 214, 216 and 218 Each of the nodes in the search tree corresponds to a 
Web page which may be on a different web server. The initial node 202 is web page 
currently received by a user such as described in Figure 1 . Branches of the tree 
represent hypertext links between the web pages. Each web page is associated with a 
web page profile that is used to track which users have visited that particular web page. 
When a user visits a web page 204 this is a good indication that it is of interest to that 
user. 

A further, better measure of interest could be employed wherein the actual 
amount of time spent by a user reading a web page is recorded. This may be 
implemented by a profiler downloaded when a user first accesses the instrumented 
pages, as an invisible applet written in a suitable language, such as Java, that collects 
information on a user's web page traversals and captures usage access patterns including 
time spent on a particular page. An example of such a profiler has been described by 
C. Shahabi and V. Shah **Java based profiler for Capturing User Access Patterns" 
http://imsc.usc.edu/profiler.html, 1997. In this manner, the time spent viewing a web 
page can be reported back to the agent at the web server by the applet. If the viewing 
time is in a certain range, the page is considered interesting to the user. The range is 
bounded by a lower threshold, set and adjustable by the user agent, below which the 
page is considered not interesting and optionally corresponding upper threshold, beyond 
which the user is considered to have abandoned the web page, rather than a page of 
high interest. The particular search illustrated is started at the users' initial node 202. 
The user formulates a search by providing a keyword 222. The user profile 224 
describing the user's background is implicitly added to the search specification. The 
user also has the option to leave the keyword unspecified. If this is done, the Web is 
searched for every document that matches the user's profile 224. Each node 202 - 208 
has a page profile, however, only page profile 220 is illustrated in Figure 2. 

As the search evolves, each of nodes 204 - 208 is tested on whether it includes 
the specified keyword. If it does, the correlation between the user profile 224 and the 



page profile for the node is computed and compared against a threshold. A high-level 
formal description of the process by which a node is tested for match is described 
below. 

5 With the following definitions: 

u user profile, u = {u,,...,u N } 

indicates whether feature i is of interest to the user 
m matching vector, m = {m,,...,m M } 
A page profile, A = {a,,..., a*,} 
10 theta threshold 

N number of features 

M number of agents or user profiles in the page profile 
The correlation between u and A computes to: 
u A = m 
15 A match occurs if: 
| ml > = theta 

Each column of A in this description corresponds to the profile of a user who 
has visited that page. Rows are added to A as a user's visit is tracked by the agent in 
charge of that page. Alternatively, a link to the user's web page is provided. Any 

2 0 obvious optimizations apply as to how these profiles are actually represented which are 
obvious to one skilled in the art. There are several standard ways to compute this 
correlation. One standard way to measure the "similarity n between two features vectors 
to compute their normalized vector product, that is, use a cosine similarity measure. 
For Boolean feature vector, this measure obtains values between 0 and 1, where values 

2 5 close to 0 indicate low, and values close to 1 high degrees of similarity, respectively. 
The similarity function is: 

sim(u,v) = cosine(u, v) 
where u and v are feature vectors, and cosine (u, v) is their normalized vector product: 
cosine (u,v) = (u*v) / (|u|*|v|) 

30 Using this similarity function to calculate the similarity between bectors {0, 1, 1, 

0, 1} and {1, 1, 0, 0, 1}, the function is: 
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sim ({0, 1, 1, 0, 1}, {1, 1, 0, 0, 1}) = 2/(sqrt(3) sqrt(3)) = .67 



Therefore, using the definitions above where u is the user profile of the new 
visitor, and a k is the k-th column in the web page profile A, the average similarity of the 
user profile u and the page profile gives a measure of the correlation between the user 
profile u and the page profile A. 

The correlation can be expressed by the formula: 

correlation (u, A) = £ sim (u, aj / M 

M 

This is further illustrated using the web page profile in Table 2 below. 

In Table 2 below, a new user with user profile {0, 1, 1,0, 1} visits the 

page: 

User Id 



Feature 


a, 


a* 


a 3 


u 


cars 


1 


0 


0 


0 


sports 


1 


1 


1 


1 


cooking 


0 


1 


1 


1 


Java 


0 


0 


0 


0 


Internet 


1 


0 


1 


1 



TABLE 2 

The correlation is calculated by comparing the new user profile with each 
column of the web page profile using the similarity function across the web page 
profile. 

sim (u, a,) = .67 
sim (u, a 2 ) = .81 
sim (u, a 3 ) = 1.00 

correlation (u, A) « (.67 +.81+1.00)73 = .83 



5 



10 



25 



A match between a user and a page is determined by comparing the correlation 
against a threshold which may be pre-defined or optionally set by the user agent. For 
example, if the threshold theta = .80, the user profile would be considered a match and 
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included in the page profile, because .83 > .80. 

If the web page profile is particularly large, it may be necessary to employ some 
optimization techniques to speed the calculation. Many optimizations are possible, for 
example, summing over a random sample of columns of the page profile, rather than 
all. 

The results of the match can be presented in several known ways, for example, 
through colour-coding the links or annotating the link with a numerical rating a 
confidence level, number or percentage in the recommendation (such as described, for 
example, Hill et al., "Recommending and Evaluating in a Virtual Community of 
Users). 

The search continues for each of the pages that meet the search criteria and has 
not been eliminated by testing for the threshold. The list of relevant pages is refined 
until they do not match the criteria, they contain no further links to other pages, or 
reach some pre-defined limit of number of results. Circular links can be handled by 
testing against a list of already successfully matched pages before a match is attempted. 
The web pages which meet or exceed the threshold are presented to the user. In this 
manner, web pages, documents and information which meets both the search criteria of 
the user, as well as correlate with interests of similar users are delivered. 

Turning to Figure 3, a preferred embodiment of the present invention, 
implemented in Java, is shown. The User Agent 302 operates as an applet stored on 
WWW Client 304. Profile Agent 1 (306) is connected to the same local area network 
300 as the user Agent 302. Profile Agent 1 (302) is implemented as a Java application 
on WWW Server 308 and manages Page Profile database 310. Profile Agent 2 (312) 
and Profile Agent 3 (318) reside on remote WWW Servers 314 and 320 
(www.soccer.com and www.cars.com), respectively. Both WWW Servers 314 and 320 
are implemented supporting Java applications. WWW Client 304, Profile Agent 1 
(302), Profile Agent 2 (306) and Profile Agent 3 (318) are provided with connections to 
the World Wide Web 324. WWW Client 304 is a standard Web browser such as 
Netscape Communicator or Microsoft Explorer and WWW Servers 306, 314 and 320 
are standard Web servers such as Netscape FastTrack or Apache server. 
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Profile Agents 306, 312, and 318 implement the HTTP protocol and behave to 
WWW Client 304 just as a typical WWW server would. Each Profile Agent 306, 312, 
and 318 implements the following three commands: search, load, and ask. The search 
command is initiated by a user to conduct a search. The load command is used to 
5 further refine a search. The ask command is used by profile agent 306, 312 and 318 to 
inquire about interest levels for linked pages. These commands have the following 
format: 

search =uid:profile:keywords 
1 0 load =uid:profile:key words 
ask=uid:profile 

Each user is assigned a unique user id (uid) when the user is set-up with user 
agent 302. Each command also includes the profile of the user initiating the command. 
1 5 The keywords which are part of the search and load commands are the words, 

separated by commas, that the user wishes to search. It is also possible to pass other 
information with each command, such as a threshold for assessing the relevance of a 
page as set by the user, as a further embodiment of the invention. 

Turning to Figure 4, the processing of the commands is described in further 

20 detail. 

The User Agent 402 provides the mechanism for the user to define his user 
profile, as previously described with respect to Figure 1, or through the use of a 
separate combination box for selecting features. 

User Agent 402 issues search command 404 on the initial screen 403 off which 

25 the user starts his search. The user Agent 402 is embedded into the Web page for the 
initial screen 403 as a Java applet. This applet displays a typical search form in HTML 
format with a field for entering keywords 406 and button 408 to set off the search. The 
applet is downloaded when the initial screen 403 web page is retrieved from the WWW 
server from which the user starts his search. If the applet code is stored as 

30 "SearchForm. class" on the WWW Server, the initial screen 403 HTML web page 
would have the following statement: 
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< applet code = SearchForm width =200 height = 50 > 

< /applet > 

5 The User Agent 402 on the initial screen 403 retrieves the user id and profile 

410 from the WWW Client. The preferred embodiment utlizes the presence of a 
"cookie" mechanism by which the web server connections (such as applets or CGI 
scripts) can both store and retrieve information on the client side of the connection. 
Such a mechanism is implemented by the major browsers, for example, Netscape 

1 0 Communicator as described in the preliminary specification of the cookie mechanism in 
"Persistent Client State HTTP Cookies", 
http : //www . netscape . com/ newsref/ std/cookiespec . html . 

Cookies are stored as name/value pairs in a designated file on the WWW Client. 
Each cookie is associated with a path and an optional expiry date. When the Java 

1 5 applet requests a cookie from the WWW Client, the path component of the applet's 
document base is compared to the path attribute, and if there is a match, the cookie is 
visible to the applet. Commercial browsers such as Netscape provide a Java class 
library for accessing cookies from within an applet. 

The cookie mechanism is applied as follows. When a first time user (which can 

2 0 be indicated by passing a special uid with the search command) submits a search 

through his User agent 402, the Profile Agent 412 at the server side generates a unique 
user id and passes it back to the User Agent 402. The User Agent 402 then creates a 
cookie on the client side of the connection that contains this user id and profile 410. 
For example, the following cookie represents a user with user id "1234" and user 

25 profile "01101" (which corresponds to the feature vector {0, 1, 1,0, 1} using a 
straightforward encoding): 

uid =1234; profile =01 101; path = / 

30 When the User Agent 402 subsequently issues a search command 404 to the 

Profile Agent 412 that created the cookie, it retrieves the user id and profile 410 from 
the cookie and sends it to the Profile Agent 412. As discussed above, a complete search 
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command contains the user id, the user profile and the list of keywords. For example, 
the following is a search command to search the Web on behalf of a user with id 
"1234" and profile "0110P for the keyword "worldcup": 

search = 1234:01 101 rworldcup 

Each WWW Server is set up having an index page which contains initial links 
from which to begin a search. This could be a database of keywords and associated 
web pages containing those key words. This database could be derived from a typical 
search engine or robot. For example, if the user connects to a WWW Server to start his 
search, the index page might contain the following HTML initial links: 

< a href = http://www.soccer.com/index.html > Soccer < /a > 

<a href = http : //www . cars . com/marketplace . html > Cars for sale </a> 

< a href =http: //intranet/home, html > ACM < /a > 

On receiving a search command, the Profile Agent 412 retrieves the index page 
from its WWW server, and issues an ask command 414 to one or more other Profile 
Agents 416 for recommendations on each document linked from the index page. With 
each ask command the user id and profile as provided. For example: 

ask= 1234:01 101 

The Profile Agent 416 for the linked page replies with the level of interest 
calculated in association with other profile agents 416 using a correlation function such 
as previously described for the given profile. Pages whose level of interest is above a 
certain pre-defined threshold, or a threshold optionally set up the user agent 402, are 
then downloaded and filtered against the optional list of keywords. In a simple filtering 
scheme, pages that do not include the keywords would be removed from the list of 
recommended links. The Profile Agent 412 then modifies the links in the original page 
by encoding and including how interesting each of them would be to the user and sends 
the modified link page back to the User Agent 402. Each link is annotated, for 
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example, through color coding or a numerical indication of the degree of confidence 
that the page is relevant to the user. 

For the above example, the Profile Agent 412 might have annotated the links as 
5 follows: 

<a href =http://www. soccer.com/index.html71oad = 1234:01 101 :worldcup > 

< font color= W #FRXXT > Soccer < /a > 
<a href = http://www.cars.com/marketplace.html> 

1 0 Cars for sale < /a > 

< a href =http://intranet/home.html?load= 1234:01 101 :worldcup > 

< font color = "#FRXXT > Intranet homepage < /a > 

Here a color coding scheme with one threshold is used. Any link that was 
1 5 recommended with a correlation at or above threshold is encoded in red (corresponding 
to the color code FFOOO in RGB format). Each color coded link also contains an 
embedded load command which contains the user id and profile 410 to be passed to the 
Profile Agent 412 for that page. The load command is separated from the actual link 
using a which is a CGI (Common Gateway Interface) convention. 
2 0 The search command is only invoked once. Subsequent refinements of the 

search are performed via load commands. For example: 

load = 1234:01 101 :worldcup 

2 5 The processing of the load and search commands are generally the same, except 

for two aspects, which warrant the separation into two commands. 

First, in the case of the load command, the host of the Profile Agent to receive 
indicated by the command is the host part of the URL which contains the load 
command. For example, if the user selects link 

3 0 http://intranet/home.html?Ioad = 1234:01 101 : worldcup 

in the page retuned by Profile Agent 412, the following information will be sent (via the 
WWW client) in the load command 419 to the Profile Agent 420 on the host 44 intranet w : 
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home.html?load= 1234:01 101:worldcup 

The Profile Agent 420 then extracts from this a local path (home.html) and the 
actual load command (load = 1234:01 101 :worldcup). 

Second, the page returned by the Profile Agent 420 in reply to a load command 
419 contains a Java applet 422 that monitors the time that the user spends reading the 
page, which the Profile Agent 420 then uses as an indication of interestingness. 

Further information on how recommendations are solicited from other Profile 
Agents and how the level of interest displayed by a user in a particular page is measured 
is described below. 

On receiving a search command 404 or load command 419, a Profile Agent 412 
or 420, as the case may be, first retrieves the appropriate page from the WWW Server 
on the same site. This is either the index page or the page at the path which was passed 
together with the search or load command. The Profile Agent 412 or 420, as the case 
may be, then extracts links to other pages from the document. For each link the Profile 
Agent 412 or 420 establishes a socket connection to the remote Profile Agent 416 or 
426 using the URL for that link. This is not necessary if the page is already on the 
local WWW Server and monitored by the same Profile Agent. The Profile Agent 412 
or 420 then sends an ask command 414 or 424 to the Profile Agent or Agents 416 or 
426 for the linked page and waits for it to reply with the interest level (correlation) for 
that page. The Profile Agent 416 or 426 for the linked page computes the correlation 
between the specified user profile 410 and the profiles stored for that page in the Page 
Profile database and returns it to the Profile Agent 412 or 420 (as the case may be) as 
the interest level. The socket is then deestablished, if necessary. 

In the example of Figure 3, the User Agent 302 would first send a search 
command with uid 1234, profile 01101, and keywords "worldcup" to Profile Agent 
306, which would then load the page intranet/index.html for the WWW Server 308. 
Profile Agent 1 (306) then sends ask commands with the same uid and profile to Profile 
Agent 2 (312) on host www.soccer.com and Profile Agent 3 (318) on host 
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www.cars.com. From the replies Profile Agent 1 (306) would then assemble a 
modified index page with embedded load commands. If the user now selects the link 
"Soccer" , WWW Client 304 would connect to Profile Agent 2 (312) which parses the 
path part of the URL into the name of a local page (index.html) to be retrieved from 
WWW Server www.soccer.com and a load command from Profile Agents linked from 
within the index.html page and sent a modified page back to the WWW Client 304. 

To capture the time spent viewing a page, a User Agent applet that measures 
time is started on loading the page to WWW Client 304. When the user changes to a 
different page (by following a link, or using one of the browser buttons like "Back", 
"Forward" etc.), the User Agent 302 reports the time spent while the page was visible 
back to the Profile Agent 312 from which the page was loaded. The User Agent 302 
applet is implemented as a invisible Java applet embedded into the Web page 
downloaded from the Profile Agent 312. To illustrate, assuming that code for the User 
Agent 302 is contained in the file "TimeTracker.class", the page assembled by the 
Profile Agent 312 must, for example, include the following statements: 

< applet code-TimeTracker width = 1 height = 1 > 

< param name-uid value — " 1234" > 
<param name = profile value = "01 101" > 

< /applet > 

The Profile Agent 312 at the server side records the information sent by the 
User Agent 302 which includes the user id, the user profile, the time spent reading the 
page and the URL of the page loaded. This information is then used to update the 
profile for that page in the Page Profile database 316. As described above, a page is 
considered interesting to the user if the time spent reading it is in a certain range. For 
such pages, the user profile is added to the page profile in the page profile database 316 
at the position indicated by the user id. If an entry for the user previously existed in the 
profile it is overwritten. This procedural interaction between the user agent 302 and 
profile agent 312 is followed for all other profile agents interacting with the user agent 
during a search. 
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Although the invention has been described in terms of the preferred and several 
alternate embodiments, those skilled in the art will appreciate other modifications and 
alternation that can be made without departing from spirit and scope of the teachings of 
the invention. All such modifications are intended to be included within the scope of the 
5 claims appended hereto. 
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CLAIMS 

1 . A method for searching and identifying relevant documents from an electronic 
search comprising the steps of: 

(a) defining a user profile for a user desiring to conduct a search; 

(b) attaching a document profile to each searchable document; 

(c) obtaining search parameters from said user; 

(d) attaching said user profile to said search; 

(e) initiating said search with said search parameters; 

(f) searching said searchable documents to identify candidate documents: 

(g) comparing said user profile to said document profile corresponding to 
said candidate document to determine a successful or unsuccessful match; 

(h) returning said candidate document to said user if successful match. 

2. The method of Claim 1, wherein said search parameters includes one or more 
key words. 

3. The method of Claim 1 , wherein said document profile contains user profiles of 
20 users who have expressed an interest in said document. 

4. The method of Claim 1, wherein said user profiles and said documents are 
managed by agents. 

25 5. The method of Claim 1, wherein said successful or unsuccessful matches are 
determined by social filtering between collaborating agents. 

6. A method for rating an electronic search comprising: 

a) creating a user profile based on typical interests; 
30 b) delivering a document to a user for viewing; and 

c) attaching said user's profile to said document where said user is 
interested in said document. 
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CLAIMS 

1. A method for searching and identifying relevant documents from an electronic 
search comprising the steps of: 

(a) defining a user profile for a user desiring to conduct a search; 

(b) attaching a document profile to each searchable document; 

(c) obtaining search parameters from said user; 

(d) attaching said user profile to said search; 

(e) initiating said search with said search parameters; 

(f) searching said searchable documents to identify candidate documents; 

(g) comparing by social filtering said user profile to said document profile 
corresponding to said candidate document to determine a successful or 
unsuccessful match; 

(h) returning said candidate document to said user if successful match. 

2. The method of Claim 1, wherein said search parameters includes one or more 
key words. 

3. The method of Claim 1, wherein said document profile contains user profiles of 
users who have expressed an interest in said document. 

4. The method of Claim 1, wherein said user profiles and said documents are 
managed by agents. 

5. The method of Claim 1, wherein said comparing by social filtering is performed 
by collaborating agents. 

6. A method for rating documents for identifying relevant documents on an 
electronic search comprising the steps of: 

(a) generating a search command from a user entity, said search command 
having a user id, user profile and search keyword; 
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(b) searching an index containing document keywords and corresponding 
linked documents, said linked documents having documents profiles; 

(c) locating one or more matches between said search keyword and said 
document keywords in said index; 

(d) asking for recommendations on said linked documents corresponding to 
said matches of said document keywords for said user id based on said 
user profile; 

(e) calculating a rating of level of interest for said recommendations for each 
said match by social filtering using said user profile and said document 
profile; 

(0 returning relevant documents of said linked documents from said matches 
to said user entity whose said rating of level of interest is above a 
threshold level. 

7. The method of claim 6 wherein said rating of level of interest is calculated by 
the correlation formula: 

^jj sim (u, / M, where: 

(a) u is said user profile; 

(b) a^ is the k* column of said document profile; 

(c) M is the number of the said user profiles in said document profile; and 

(d) sim (u, aj is the similarity between said user profile and the k* column 
qf said document profile. 
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